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Abstract 



Background: Germany, like many other countries, will soon have a 
shortage of qualified doctors. One reason for the dissatisfaction amongst 
medical residents are the relatively unstructured residency training 
programs despite increasing importance of outcome-based education. 
The aim of our study was to identify characteristics and requirements 
for good teaching during anesthesiology residency training from the 
resident's point of view. 

Methods: A consensus workshop with residents from all medical univer- 
sities in Germany was held. Participants were allocated to one of the 
three topics, chosen based on a 2009 nationwide evaluation of resi- 
dency. The three topics were (A) characteristics of helpful/good teachers, 
(B) characteristics of helpful/good conditions and (C) characteristics of 
helpful/good curricular structure. Each group followed a nominal group 
technique consensus process to define and rank characteristics for a 
good residency. 

Results: 31 (79.5%) resident representatives were present. The con- 
sented results put emphasis on the importance of structured curricula 
includingtransparent goals and objectives, in trainingformative assess- 
ments and quality assurance measures for the program. Residents 
further long for trained trainers with formal teaching qualifications and 
protected teaching time. 

Conclusions: Good residency training requires careful consideration of 
all stakeholders' needs. Results reflect and extend previous findings 
and are at least to some degree easily implemented. These findings 
are an important step to establish a broader consensus within the dis- 
cipline. 

Keywords: residents, curriculum development, needs assessment, 
anesthesiology, consensus 

Zusammenfassung 

Hintergrund: In Deutschland wird es, wie in vielen Landern, in absehba- 
rer Zukunft einen Mangel an qualifizierten Arzten geben. Einer der 
Grunde fur Unzufriedenheit unter den Weiterbildungsassistenten sind 
die relativ unstrukturierten Weiterbildungsprogramme trotz der zuneh- 
menden Wichtigkeit von Ergebnis-orientierter Weiterbildung. Ziel dieser 
Studie ist es, Charakteristika von und Anforderungen an gute Lehre 
wahrend der anasthesiologischen Facharztweiterbildung aus Sicht der 
Weiterzubildenden zu identifizieren. 

Methoden: Es wurde eine Konsensus-Konferenz mit Weiterzubildenden 
von alien 39 anasthesiologischen Universitatskliniken Deutschlands 
durchgefuhrt. Die Teilnehmer wurden Gruppen zu einem von drei The- 
men zugeordnet, die anhand der nationalen Evaluation der Weiterbil- 
dung 2009 identifiziert wurden. Diese Themen waren (A) Charakteristika 
hilfreicher/guter Weiterbildner, (B) Charakteristika hilfreicher/guter 
Bedingungen und (C) Charakteristika hilfreicher/guter Curriculumsstruk- 
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tur. Jede Gruppe folgte dem Nominal-Group-Technik-Konsensprozess, 
um Charakteristika guter Weiterbildungzu definieren und zu priorisieren. 
Ergebnisse: 31 (79,5%) Assistentensprecher waren anwesend. Die Er- 
gebnisse betonen die Bedeutung strukturierter Curricula inklusive 
transparenter Ziele und Inhalte, formativer Zwischenprufungen und 
QualitatssicherungsmaSnahmen der Programme. Weiterbildungsassis- 
tenten wunschen sich zudem ausgebildete Weiterbildende mitformaler 
Lehrqualifikation und geschutzte Zeit zum Lehren. 
Schlussfolgerung: Gute Facharztweiterbildung setzt eine sorgfaltige 
Berucksichtigungder Bedurfnisse aller Beteiligten voraus. Die Ergebnis- 
se bestatigen und erweitern bisherige Publikationen und konnen zum 
Teil einfach umgesetzt werden. Die Ergebnisse sind ein wichtigerSchritt 
hin zu einem breiteren Konsens innerhalb einer Fachdisziplin. 

Schlusselworter: Weiterbildungsassistenten, Curriculumsentwicklung, 
Bedarfsanalyse, Anasthesie, Konsensus 



Introduction 

Germany, like many other countries, will soon have a 
shortage of qualified doctors. Many possible reasons for 
this shortage are discussed in the literature: The current 
generation of medical students (generation Y) are unlikely 
to accept poor training conditions. They may well leave 
the hospital or indeed the country to get better training 
[1], [2], [3]. Hospitals currently react to these new chal- 
lenges with random isolated measures [3]. 
New planning tools are necessary to cope with the chal- 
lenges medicine and especially anesthesiology will face 
in the future. Outcome-based education has become the 
gold standard in curriculum development for residency 
training [4], curricula focus on outcomes and their descrip- 
tion [5]. Many countries have already developed a struc- 
tured outcome-based curriculum for various levels of 
training (e.g., for specialties and subspecialties) in order 
to assure high quality of future health care [4], [6], [7], 
[8]. In Germany the German Association for Medical 
Education (Gesellschaft fuer Medizinische Ausbildung 
(GMA)) and The Council of Medical Faculties (Medizini- 
scher Fakultaetentag (MFT)) have begun to develop a 
competency-based catalogue of learning objectives to 
inform undergraduate medical education [9]. A catalogue 
for the purpose of residency training is planned by the 
same Association [10]. 

In 2009 the German Medical Council (Bundesaerztekam- 
mer) conducted the first nationwide evaluation of resi- 
dency training in all medical subspecialties including 
residency trainers and residents. The evaluation was 
conducted analogous to German school marks (1 = excel- 
lent, 6 = poor). Global rating of residency training was 
fairly good with 2.54. There were eight question domains 
(global rating, medical expert teaching, learning culture, 
leadership, culture of error prevention, culture of decision 
making, workplace culture, application of evidence-based 
medicine). Compared to all specialties, anaesthesiology 
performed below average in seven of the eight question 
domains. Only "management of medical errors" received 
higher-than-average ratings. The nationwide evaluation 



identified different fields where need for change was 
deemed necessary: 

1. Trainers: need to develop a tutor system for residency, 
train the trainer programs for clinical teachers. 

2. Conditions: need to develop family friendly hourly 
working schedule, optimization of pathways in hos- 
pitals and within a specialty department. 

3. Curriculum: need to develop well-structured residency 
training curricula, publication of best practice models, 
reform of residency training regulations, possibility of 
residency training programs or rotations to different 
sites as part of a network [11], [12]. 

The follow-up survey in 2011 showed only slightly better 
results with the same pattern [13]. 
Given this situation there is a need for more structured 
approaches to curriculum development in Germany in- 
cluding development of appropriate learninggoals, imple- 
mentation and assessment as well as quality assurance 
of graduate medical education on a national level [10]. 
According to Kern different stakeholders have to be in- 
volved in this task. Societal and patient needs should be 
taken into account as well as the needs of clinical 
teachers, residents and employers [14]. While the needs 
of teachers, medical societies and employers at least 
partly manifest through council regulations of residency 
training programs, patient as well as residents needs are 
generally less frequently sought. We approached one of 
these groups to contribute to the necessary discussion. 
The aim of our study was to identify characteristics and 
requirements of good teaching in anaesthesiology resi- 
dency training from the resident's point of view. We con- 
ducted a focused general needs assessment in the spe- 
cialty of anaesthesiology as defined by Kerns six-step 
approach to curriculum development [14]. 

Methods 

In order to generate a generic list of characteristics and 
requirements for all three main topics of the above 
mentioned nationwide evaluation we conducted a con- 
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Table 1: Topics and literature for preparation 



Topics 


Literature for preparation 


A. Characteristics of 
helpful/good teachers 


- AMEE Guide No. 27: Effective educational and clinical supervision [33] 

- Workplace-based assessment as an educational tool: AMEE Guide No. 31 [28] 


B. Characteristics of 
helpful/good conditions 


- Continuing medical education: AMEE Education Guide No 35 [34] 

- Learning in inter-professional teams: AMEE Guide No 38 [35] 

- Being a young and inexperienced trainee anesthetist: a phenomenological study 
on tough working conditions [36] 


C. Characteristics of helpful/ 
good curriculum structure 
and rotation culture 


- ABC of learning and teaching in medicine. Curriculum design [37] 

- Competency-based education as a steering instrument for residency training in 
anesthesiology [38] 



sensus workshop for residents. It took place during one 
of the main conferences of the German Association of 
Anesthesiologists (Deutsche Gesellschaftfuer Anaesthesi- 
ologie und Intensivmedizin) in Berlin in September 2011 
(13. Hauptstadtkongresses der Deutschen Gesellschaft 
fuer Anaesthesiologie und Intensivmedizin). 

Sample (participants) 

To maximize legitimacy we invited one elected resident 
representative (Assistentensprecher) from all 39 German 
departments of anesthesiology at university hospitals 
[15]. The invitation was carried out in three steps: All 
anesthesiology departments at university hospitals were 
asked by e-mail to send one of their resident representa- 
tives to the workshop. In a second step all institutions 
that hadn't replied were reminded by a second e-mail 
and asked to send one of their resident representatives 
or a substitute. In a third step all resident representatives 
of non-responding institutions were contacted personally 
by WB by e-mail or phone and asked to attend or send a 
substitute. All workshop participants gave their written 
consent to publish the data gained in the consensus 
process as well as aggregated participant information. 
Ethical approval was deemed unnecessary for this work- 
shop in our institution. 

Workshop preparation and topics 

Participants were informed two weeks prior to the work- 
shop about the three topics of the workshop (see Table 1), 
were asked to subscribe to one of the three workshop 
groups and to provide a preference list of the given main 
topics in case the preferred group could not be allocated 
to everyone. Workshop places were allocated on a first 
come first served basis, everyone was allocated to the 
group of their first choice (see Table 1). To familiarize 
participants with concepts and current debates in their 
topic all participants received two to three articles to 
prepare for the workshop five days before the workshop 
took place (see Table 1). Selected articles were reviews 
and related to the group topics as well as articles focused 
on residency training in anesthesiology related to group 
topics. 



Instruments: Workshop and Nominal 
Group Technique 

The workshop was divided into three parts from noon to 
5.30 pm. After a brief welcome and introduction we stated 
the workshop goal: to identify characteristics and require- 
ments for good residency training in anaesthesiologyfrom 
the resident's point of view. We split the group into the 
three working groups covering the topics (A) characteris- 
tics of helpful/good teachers, (B) characteristics of help- 
ful/good conditions and (C) characteristics of helpful/good 
curricular structure and rotation culture. Each group was 
facilitated by at least one anesthesiologist and a second 
facilitator. At least one of the facilitators per group was 
familiar with the Nominal Group Technique (NGT) method 
and had applied it previously in other workshops. Groups 
were obliged to use the NGT to steer the workshop as 
recommended for clinical guideline development [16], 
[17], [18], [19]. The NGT consists of five steps: (1) 
brainstorming, (2) prioritizing, (3) collection of ideas, (4) 
discussion and clustering, (5) ranking (see Table 2). The 
result of the NGT is a prioritized list of idea-clusters and 
concepts. At the top of the list is the idea-cluster with the 
highest ranking priority followed by all idea-clusters in 
decreasing priority. In part three of the workshop, group 
results were presented to all participants and discussed 
in a plenary session. Group results could only be changed 
from the plenary if there was consensus that there is 
strong concern of misunderstanding within the group 
results. All participants consented to the results. 

Statistics 

Data were collected by photography and manually tran- 
scribed. Descriptive statistics were carried out using 
SPSS version 20. 

Results 

Sample (participants) 

31 (79.5%) resident representatives (or their substitute) 
out of 39 invited participants were present during the 
consensus process. 14 (45.2%) participants were female 
and 17 (54.8%) were male. Five (16.1%) of the parti- 
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Table 2: The five stages of nominal group technique used during the workshop [16], [17], [19], duration and aim in the described 

consensus process 



Step 


Duration 


Description 


Aim 


Brain-storming 
(silent gener- 
ation of ideas) 


10 min 


Every participant writes down all his/her ideas to the 
given topic. Every idea is put down on an individual 
card. Participants don't consult or discuss. 


Open collection of ideas 
independent of group 
process to allow as many 
ideas to rise as possible. 


Individual 
prioritization 


5 min 


Every participant performs individual ranking of 
relevance regarding his/her ideas. 


Preparation of structured 
sharing 


Sharing ideas 


30 min 


The first priority idea-cards are shared one at a time by 
all participants and collected on a pin-board. The ideas 
of lower priority subsequently follow. Every participant 
can explain the content briefly with no debate about the 
items. New ideas that arise from the sharing process 
should be written down also. The round robin process 
continues until all ideas have been presented or until 
30 min have passed. Ideas that weren't mentioned 
within 30 min are discarded. 


This process ensures all 
participants get an 
opportunity to make an 
equal contribution and 
provides a written record 
of all ideas generated by 
the group. 


Discussion and 

clustering/ 

categorizing 


60 min 


Participants can seek verbal explanation or further 
details about any of the ideas that may not be clear to 
them. The process is kept as neutral as possible to 
avoid judgment and criticism. The group may suggest 
new items for discussion and combine items into 
categories. 


Individual ideas are put 
together to concepts. 


Ranking 


15 min 


Prioritizing the recorded categories or clusters by 
ranking them. All participants are to rank individually at 
the same time. The workshop question must be kept in 
mind. Rankings of all participants are summed up. 


The concepts are ranked 
by importance. The 
result is a list of catego- 
ries in order of highest 
priority first and less 
important categories last. 



cipants had already passed the anesthesiology specialty 
examination. 

Mean time of residency duration (excluding the candi- 
dates that had already passed their specialty examina- 
tions) was 3.16 years (median 4, minimum 2, max- 
imum 7) out of a 5-year program. Only one participant 
had children. 

Consensus process 

During the plenary presentation of the group results and 
the consensus discussion, the topic "patient safety" was 
heavily debated. Some groups had listed "patient safety" 
amongst their results. The plenary group discussed 
whether it was suitable to allocate "patient safety" to a 
prioritizing list even if this was not listed as the first prior- 
ity. Patient safety was stressed as an overarching theme 
of residency training which was not explicitly matching 
any other specific category and therefore removed from 
the prioritizing lists to avoid misunderstanding. This was 
the only topic on which the plenary made a change to the 
results of the groups. 

Group A worked on the topic "characteristics of helpful/ 
good teachers" and developed eleven categories. Fifteen 
categories were developed by Group B on the topic 
"characteristics of helpful/good conditions". Group C 
worked on the topic "characteristics of helpful/good cur- 
ricular structure and rotation culture" and developed eight 
categories. The consented categories of group A, Band C 



with a ranking sum and in ranking order are summarized 
in Table 3, Table 4 and Table 5. 

Discussion 

We were able to ensure a broad consensus within the 
group of workshop participants on the key characteristics 
for a good residency. The results give a broad overview 
of possible changes suggested by residents and a lot of 
the prioritized characteristics for a good residency would 
require little effort to put into action. Although the ranking 
orders are not equidistant, they provide an order of more 
and less importance. 

Our results elaborate on the needs and expectations of 
generation Y. Most of the results from group A on the 
characteristics of helpful/good teacher like "Can patiently 
instruct and explain", "Creates a trusting and open 
learning climate" as well as the results B2 "Appreciates 
staff" and B5 "Good interprofessional and interdisciplinary 
working climate" of group B on the characteristics of 
helpful/good conditions strengthen the introductory claim, 
that medical students and junior residents especially 
from generation Y are not willing to accept poor training 
conditions. 

The reported need for development of appropriate and 
transparent learninggoals and structure [10] is reflected 
in our findings. Namely in the results A 4.2 "Has a 
concept", B3 "Clear structure to residency training" and 
CI to C3 "Training culture", "Step-by step definition of 
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Table 3: Results of group A "characteristics of helpful/good teachers" 



Number 


Ranking 
place 


Categories 


Ranking 
sum 


A 'I 

A 1 


A 
\ 


Will and wish to teach 


-1 o 


A O 

A Z 


o 


Medical expertise is up to date 


i -1 
ol 


A *3 
A O 


o 
O 


Can explain 


A Q 

4o 


A A 'I 

A 4. 1 


4 


Can patiently instruct and explain 


ou 


A A O 
A 4.«L 


4 


Has a concept 


OU 


A6 


6 


Creates a trusting and open learning climate 


62 


A7 


7 


Can assess 


64 


A8 


8 


Able to take the time to teach 


77 


A9 


9 


Has completed teacher training 


85 


A 10 


10 


Is open to criticism 


89 


A 10 


11 


Provides a safe environment for the resident 


92 



Table 4: Results of group B "characteristics of helpful/good conditions" 



Number 


Ranking 
place 


Categories 


Ranking 
sum 


B 1 


1 


Accountability 


43 


B2 


2 


Appreciates staff 


44 


B3 


3 


Clear structure to residency training 


60 


B4 


4 


Sufficient supervision 


65 


B5 


5 


Good interprofessional and interdisciplinary working climate 


70 


B6 


6 


Overcome pressure of production 


82 


B7 


7 


Culture for managing of medical errors 


89 


B8 


8 


Adherence to labor agreements 


102 


B9 


9 


Adherence to laws on working hours 


103 


B 10 


10 


Operating room organization suitable for residency training 


107 


B 11 


11 


Reliable on duty-schedule versus flexibility 


113 


B 12 


12 


Family friendly workplace 


120 


B 13 


13 


Everyday feedback 


122 


B 14 


14 


Standard operating procedures 


134 


B 15 


15 


Transparent staff policy 


138 



Table 5: Results of group C "characteristics of helpful/good curricular structure and rotation culture" 



Number 


Ranking 
place 


Categories 


Ranking 
sum 


C 1 


1 


Training culture (time, money, culture of teaching and 
learning, evaluation, trained teachers) 


25 


C2 


2 


Step-by step definition of theoretical and practical learning 
objectives and corresponding teaching 


33 


C3 


3 


Structured familiarization period 


36 


C4 


4 


Predictable, structured and transparent rotation planning 


38 


C5 


5 


Communication and culture for management of medical errors 


52 


C6 


6 


Regular simulator training as a team 


59 


C7 


7 


Step-by step summative and formative assessment of 
theoretical and practical skills/learning success 


66 


C8 


8 


Education internally and externally possible 


71 



theoretical and practical learning objectives and their 
teaching", "Structured familiarization period". These re- 
quirements are not met in all programs as the nationwide 
surveys by the Bundesaerztekammer demonstrates [11], 
[12], [13]. The results also confirm and extend previous 



findings on residency training in the specialty of anesthesi- 
ology [20], [21], [22], [23]. One survey of 770 residents 
at German hospitals revealed that only about one third 
of residents are able to find a structure in their training 
program [23]. In the most recent survey, only 42.2% of 
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residents rated their training program as structured [24]. 
This situation is unsatisfactory, as one would assume 
that well-structured residency curricula would facilitate 
a more effective learning environment, followed by en- 
hanced clinical practice and improved patient safety in 
future generations of physicians [25], [26]. Necessary 
changes in this domain are relatively easy to achieve and 
are inexpensive. They might be implemented by political 
will in single hospitals. 

The topic of implementation and assessment of compe- 
tency-based graduate medical education [10] is reflected 
in A7 "Can assess" and C7 "Step-by step summative and 
formative assessment of theoretical and practical skills/ 
learning success". Changes in assessment methods like 
performance testing, namely OSCE and portfolio [27], 
workplace-based assessment e.g. using DOPS or Mini- 
CEX [28] or even multi source feedback [29], [30] and 
others need content experts, are labor intensive and 
therefore need nationwide initiatives and financial sup- 
port. 

The important aspect of quality assurance of graduate 
medical education [10] is reflected in the following find- 
ings: "Predictable, structured and transparent rotation 
planning", Bl "Accountability", as well as A9 "Has com- 
pleted teacher training". Taking into account that hos- 
pitals are not reimbursed for residency training in the 
German medical system, departments can rarely afford 
staff specifically dedicated to clinical teachingand super- 
vision. 

The proposed changes may only be feasible if they are 
developed and implemented nationally to save costs. 
Financial support to develop more structured curricula 
and provide more supervision seems necessary as Ertmer 
reports a decrease in clinical supervision of anaesthesi- 
ology residents in German hospitals [24]. 
Further research and regular program evaluation is 
needed to reveal which measures are more educationally 
and financially effective than others [10]. 
There are several limitations to the interpretation of the 
presented data. We invited only one elected resident 
representative (Assistentensprecher) per anesthesiology 
department from all German university hospitals. Their 
point of view may vary from residents trained in smaller 
hospitals. In the most recent anesthesiology survey 
32% of residents were trained in small hospitals (Regel- 
versorgung), 39% at large hospitals with all subspecialties, 
29% at university hospitals [24]. 
In addition, only one of the participants had children, 
which may explain why family friendliness at the work- 
place does not seem to be of great importance in our 
results. Mean time of residency duration in our study 
population was slightly above three years out of a five- 
year program. 45.2% of our participants were female. 
These aspects might play a role in preferences. A Swiss 
survey reported that career related issues became less 
important for specialty choice with advancing training 
status. The same survey reported work- and time-related 
aspects are more important for women than for men. 



With an increasing number of female residents, training 
programs should adapt to this particular aspect [31]. 
Furthermore, we only asked residents and not teachers, 
representatives of other health care professions or pa- 
tients to participate in our workshop. We wanted to give 
residents the opportunity to exclusively give their point 
of view without being influenced by others. Other studies 
have shown that clinical faculty and residents at least in 
family medicine have a shared view of the ideal clinical 
teacher. The believed ideal clinical teacher for residents 
and faculty was stimulating, encouraging, competentand 
communicative; and not conventional, cautious or con- 
trolling, a finding well reflected in the results of our 
workshop group A. They only differed in the descriptors 
"Probing" and "Innovative", both more important for fac- 
ulty than for residents, thus differences in views might 
be minimal [32]. 

The next step to develop quality residency in German 
anesthesiology could be a nationwide Delphi process in- 
volving at least residents and resident teachers to accom- 
plish a broader consensus and in order to involve and 
motivate people that are involved in everyday teaching 
in the hospitals. Delphi processes are shown to be effect- 
ive and recommended in other curriculum development 
processes [14], [18], [19]. 

The results of our workshop were presented in a scientific 
session to senior faculty staff during the congress in which 
the workshop took place: the reception of results and the 
following discussion showed a general agreement with 
the presented findings among the auditorium and con- 
veyed their encouragement to proceed in seeking con- 
sensus from a larger group of stakeholders. It would be 
beneficial to involve other healthcare professionals and 
patients in such a process if deemed feasible. 

Conclusions 

Good residency training curricula require careful consid- 
eration of all stakeholders' needs. Characteristics of good 
residency as defined by residents are at least to some 
degree easy to implement and reflect previous findings 
from the literature. These preliminary findings are an 
important stepping stone in establishing a broader con- 
sensus within the discipline. 
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